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ABSTRACT 

An  algorithm  is  described  for  determining  the  optimal  solution  of 
parametric  linear  and  quadratic  programming  problems  as  an  explicit  piece- 
wise  linear  function  of  the  parameter.  Each  linear  function  is  uniquely 
determined  by  an  appropriate  subset  of  active  constraints.  For  every  crit¬ 
ical  value  of  the  parameter  a  new  subset  has  to  be  determined.  A  simple 
rule  is  given  for  adding  and  deleting  constraints  from  this  subset. 
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SIGNIFICANCE  AND  EXPLANATION 


In  many  applications  of  linear  and  quadratic  programming  it  is 
necessary  to  obtain  an  optimal  solution  for  more  than  one  set  of  input 
data.  In  particular,  if  the  right  hand  sides  of  the  constraints  Ax  <  b 
can  be  interpreted  as  capacities,  it  might  be  useful  to  study  the  behavior 
of  the  optimal  solution  if  b  is  replaced  by  c  +  tp  ,  where  t  is  a 
parameter  which  varies  in  some  intervall,  say  [t  ,  t]  .  Similarly,  if  the 
coefficients  of  the  objective  function  c'x  are  prices,  it  is  sometimes 
desired  to  compute  the  optimal  solution  for  all  objective  functions  of  the 
form  (c  +  t  q) '  x  for  t  £  U  ,  t]  . 

Parametric  problems  of  this  type  have  the  following  basic  property. 

There  are  critical  values  t  «  t.  <  t,  <  ...  <  t  =  t  such  that  the 

—  o  l  v 

optimal  solution  is  a  linear  function  of  t  for  tj  <  t  <  tj+^  .  This 
linear  function  can  be  computed  from  a  linear  system  of  equations  which 
is  determined  by  a  certain  set  of  active  constraints.  For  each  critical 
value  of  t  this  set  of  active  constraints  changes. 

It  can  happen  that  for  some  critical  values  of  t  the  new  set  of 
active  constraints  differs  from  the  previous  one  by  several  constraints. 

In  this  case  determination  of  the  correct  set  can  be  tedious.  This  diffi¬ 
culty  can  be  overcome  by  a  simnle  selection  rule  which  results  in  a  finite 
number  of  intermediate  sets  which  differ  from  each  other  by  exactly  one 
constraint.  Therefore,  che  problem  reduces  to  the  simple  case  of  con¬ 
secutive  sets  of  active  constraints  which  are  obtained  from  each  other  by 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptis 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


ON  PARAMETRIC  LINEAR  AND  QUADRATIC 
PROGRAMMING  PROBLEMS 


Klaus  Ritter 


1.  Introduction 


In  practice  it  is  often  important  to  study  the  behaviour  of  the  opti¬ 
mal  solution  of  a  linear  or  nonlinear  programming  problem  if  some  of  the 
data  change.  In  this  paper  we  consider  linear  und  convex  quadratic  minimiza¬ 
tion  problems  with  the  property  that  the  right  hand  side  of  the  constraints 
and/or  the  linear  part  of  the  objective  function  depend  linearly  on  a  para¬ 
meter  t  which  varies  in  a  certain  intervall.  It  is  known  [3]  that  in  these 
cases  the  optimal  solution  is  a  piecewise  linear  function  of  the  parameter. 
There  is  a  finite  number  of  critical  values  of  the  parameter  for  which  the 
representation  of  the  optimal  solution  as  a  function  of  t  changes.  These 
critical  values  are  characteri zed  by  the  fact  that  the  set  of  constraints, 
active  at  the  optimal  solution  changes.  In  a  reoular  case  when  exactly  one 
active  constraint  becomes  inactive  or  exactly  one  inactive  constraint  be¬ 
comes  active  it  is  not  difficult  to  find  the  new  representation  of  the 
optimal  solution  as  a  function  of  t  .  However,  in  a  degenerate  situation 
where  for  a  critical  value  t-  of  the  parameter  several  constraints  be¬ 
come  newly  active  and/or  several  multipliers  become  zero,  it  may  be  tedious 
to  find  the  correct  set  of  constraints  which  determine  the  optimal  solution 
for  t  >  t .  . 

It  is  the  purnose  of  this  paper  to  describe  a  method  which  can  be  used 
to  overcome  these  difficulties.  For  every  value  of  the  parameter  for  which 
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the  given  problem  has  an  optimal  solution,  the  Kuhn-Tucker-condi tions 
(see  e.g.  [21)  and  an  appropriately  chosen  set  of  constraints  can  be  used 
to  determine  the  optimal  as  a  function  of  the  parameter  by  solving  a  linear 
system  of  equations.  For  a  regular  critical  value  of  t  the  selected  set 
of  constraints  is  changed  in  one  of  the  following  ways.  Either  a  constraint 
is  added  to  the  set  or  a  constraint  is  deleted  from  the  set  or  both.  In  a 
degenerate  case  it  could  be  necessary  to  repeat  this  procedure  several  times 
before  the  correct  set  of  constraints  is  obtained.  In  order  to  avoid  cycling 
the  selection  of  the  constraint  that  enters  or  leaves  the  considered  set 
has  to  be  made  with  some  caution.  It  is  shown  that  cycling  does  not  occur 
if  the  following  rules  are  used.  First,  adding  a  constraint  to  the  selected 
set  has  priority  over  deleting  a  constraint  from  the  set.  Second,  if  there 
are  several  candidates  for  entering  or  leaving  the  set  in  each  case  the 
one  with  the  smallest  index  will  be  chosen.  The  advantage  of  this  method 
is  that  renular  and  degenerated  critical  values  of  t  are  treated  in  the 
same  way.  The  only  difference  is  that  in  the  degenerate  case  more  than  one 
change  of  the  selected  set  of  constraints  could  be  necessary. 

In  the  following  section  we  give  a  precise  statement  of  the  problem 
and  establish  some  preliminary  results.  In  Section  3  basic  nroperties  of 
parametric  quadratic  programming  problems  and  their  relation  to  the  proposed 
method  are  given.  In  the  final  section  an  alaorithm  is  described  for  compu¬ 
ting  the  ootimal  solution  as  an  explicit  function  of  the  parameter.  It  is 
shown  that  it  terminates  after  a  finite  number  of  iterations. 


2.  Formulation  of  the  problem  and  preliminary  results 


l.et  c,  q,  and  x  be  n-dimensional  column  vectors  and  let  A  and 

b  with 

A'  =  (a: . am)  ,  b*  =  ((b)1,...,(b)m) 

bo  an  (n\n) -matrix  and  an  m-dimensi onal  column  vector,  respectively.  Further¬ 
more,  assume  that  C  is  a  symmetric  positive  semi -def ini te  (n.n)-natrix.  We 
consider  the  problem  of  determining  the  optimal  solution  to 
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min|(c  +  tq)'x  +  -jx'Cx|Ax  <  b  +  t  p  (2.1) 

a?  an  explicit  function  of  the  parameter  t  for  all  values  of  t  with 

t  s  t  s  t  . 

If  C  =  0  ,  then  the  parametric  quadratic  programming  problem  (2.1)  reduces 
to  a  parametric  linear  programming  problem. 

Because  C  is  assumed  to  be  positive  semidefinite  it  follows  from  the 
Kuhn-Tucker-Theorem  (see  e.g.  [2]),  that  x  is  an  optimal  solution  to  (2.1) 
if  and  only  if  there  is  a  vector  u  €  Em  such  that 


Cx  +  A'u  =  -  (  c  +  t q  ) 
Ax  <  b  +  t  p 

u'(Ax-b-tp)  =  0,  u  >  0  . 

Troughout  this  paper  we  assume  that 
rank  (C,  A' )  =  n  . 


(2.2) 


(2.3) 


The  purpose  of  this  assumption  is  to  guarantee  that  if  (2.1)  has  an  optimal 
solution  for  some  t  it  also  has  an  optimal  solution,  x  say,  which  is  the 
unique  optimal  solution  in  the  intersection  of  the  constraints  that  are  active 
at  x  .  This  fact  is  established  in  the  following  lemma. 

Lemma  1 

If  rank  ( C ,  A ' )  =  n  and  (2.1)  has  an  optimal  solution  for  some  t  , 
then  there  is  a  set  I  c  ;l,2,...,m)  and  an  optimal  solution  "x  of 
(2.1)  such  that 

i)  The  vectors  a-,  i  €  I,  are  linearly  independent 
ii)  x  is  the  unique  optimal  solution  to  the  problem 

min|(c  +  tq)' x+^x'Cx  !  al  x  =  (b)i  +  t(p)i  ,  i  €  I  \  . 


Proof: 

For  t  =  t  let  xQ  =  x  ( t)  be  any  optimal  solution  to  (2.1).  Cefine  the  set 
IQ  cr  {1,2, ...,m;  such  th  tt  ’  f  I  if  and  only  if 


(2.4) 


ai  xo  =  (b)i  +  b(p)i  • 

If  xQ  is  the  unique  optimal  solution  to  the  problem 

min  j  (c  +  tq) ‘  x  +  -^  x'Cx  |  ai  x  =  (b) .  +  t(p)^  ,  i  €  IQ ) 

it  suffices  to  set  x  =  xQ  and  to  choose  any  maximal  subset  I  e  IQ  such 
that  the  vectors  a^  ,  i  €  I  ,  are  linearly  independent. 

Now  suppose  that  xQ  *  xQ  is  an  optimal  solution  to  (2.1).  Set 

s  =  x  -  x„  and 
o  o 

A.  /\  1 

Q(x  :  t)  =  (c+tq)'x+-jx'Cx. 

Then  it  follows  from  the  convexity  of  Q(x;  t)  that 

Q(x0  +  as;  t)  =  Q(xq  ;  t)  for  all  ;  .  (2.5) 

This  implies  that  s’Cs  =  0  and,  because  C  is  positive-semi  definite, 

Cs  =  0.  Therefore,  it  follows  from  (2.3)  and  the  relations 

a-  s  =  0  ,  i  €  IQ  (2.6) 

that  there  is  i  ,  i  €  I  ,  such  that  a‘.  s  *  0  .  Hence  we  deduce  from 

(2.5)  and  (2.6)  that,  for  some  aQ  , 

*1  =  *0  +  °o 5 

is  an  optimal  solution  to  (2.1)  with 

a*.  Xj  =  (b)i  +  t(p)i  ,  i  e  Ij  , 

where  I  c  1^  and  IQ  *  Ij  .  Repeatinc  this  argument  if  necessary  we 
obtain  an  optimal  solution  x  to  (2.1)  and  a  set  I_  c  {l,2,...,m}  such 

that  x  is  the  only  optimal  solution  to  (2.1)  which  satisfies  the  equations 

a-  x  =  (b)i  +  t(p)i  ,  lei,.  (2.7) 

Setting  x  =  x  and  choosing  any  maximal  subset  I  c  I,,  such  that  the 

vectors  a.  ,  i  €  I  ,  are  linearly  independent  completes  the  proof  of  the 

1 emma . 
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In  the  following  sections  we  will  associate  with  each  t  €  It,  t] 

A 

for  which  (2.1)  has  an  optimal  solution  a  matrix  A  and  an  optimal  solution 
x  with  the  properties  specified  in  the  above  lemma.  Let 

av  x  -  (b)v  +  (2.8) 

be  any  constraint  which  for  t  =  t  is  active  at  the  optimal  solution  x  . 
Then  this  constraint  is  said  to  be  a  primary  active  constraint  if  a,  is  a 

column  of  A'.  If  a^  is  not  a  column  of  A'  ,  then  (2.4)  is  referred  to 
as  a  secondary  active  constraint. 

For  later  reference  we  prove  the  following  lemma. 

Lemma  2 

The  matrix 

ft  = 

is  nonsingular  if  and  only  if  the  following  conditions  are  satisfied 
i)  The  columns  of  A'  are  linearly  independent, 

ii)  x'Cx  >  0  for  every  x  *  0  with  Ax  =  0  . 


Proof: 

First  assume  that  the  conditions  of  the  lemma  are  satisfied.  Let  (x,y)  be 
any  solution  of  the  equations 

C  x  +  A'  y  =  0 

(2.0) 

Ax  =  0  . 

Then  x’Cx  =  -  y’Ax  =  0  implies  x  =  0  .  Thus  A'y  =  0  and,  therefore, 
y  =  0  .  This  shows  that  H  is  nonsingular. 

If  the  columns  of  A’  are  linearly  dependent  it  follows  immediately 
that  M  is  singular.  Finally,  if  there  is  x  *  0  with  x'Cx  =0  and 
Ax  =  0  ,  then  Cx  =  0  and  (x,  0)  is  a  solution  of  the  equations.  Hence, 
M  is  sinnular. 


3.  Basic  properties  of  parametric  quadratic  and  linear  programming  problems 

For  t  =  t-  let  x-  =  Xj(t)  be  an  optimal  solution  to  (2.1)  for  which 
assumption  (2.3)  is  satisfied.  Re-numbering  constraints  if  necessary  and 
using  Lemma  1  we  can  assume  that 

a^  Xj  =  (b).j  +  tj(p).j  ,  i=l,. ...o 

a;  xj  <  (b).  +  tj(p).  ,  1*o+l,.... m 

and  x-  is  the  unique  optimal  solution  to 

J 

min  |  (c  +  tj  q)'  x  +  -^  x'C  x  I  Aj  x  =  +  tj  Pj  ^  , 

where,  for  some  v  <  o  , 


-  (ai< 


,a  ) 
v' 


=  ((b)1,...,(b)v)  ,  Pj  =  ((P)r..-(P)V) 


and  the  columns  of  AL  are  linearly  independent. 

Let  u-  =  u-(t-)  >0  be  such  that 
J  J  J 

C  Xj(tj)  +  A1  Uj(tj)  =  -  (c  +  tj  q) 

with  (u-).  =  0  for  i=v+l,...,m  .  Then  the  optimality  conditions 
be  written  in  the  form 


(2.2)  can 


Cxj(t)  +  Vj(t) 

=  -  (c  +  tq) 

(3.1) 

Aj 

*  Vtpo  • 

a-  x.(t)  <  (b)i  + 

t(p) ■  ,  i=v+l,. . . ,m 

(3.2) 

Vj(t)  >  0  , 

(3.3) 

Vj ( t)  €  E v  and 

(vj(t))i  =  (uj(t))i  ,  i=l... 

, .  ,v  . 
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Since  by  Lemma  2, 


C  ,  Ai 
M,  =  |  J 

V  0 

is  nonsingular,  the  inverse  matrix 


M 


_!  j  Mlj  *  M2j 
M3j  *  % 


exists. 


Setti ng 

hlj  '  -  Vcttjq)  +  WW  '  h2j  = 
hi  =  -  VC  +  tj',)  +  M4j(bj  +  tjPj)  ■  -2j  ■ 

we  obtain  from  (3.1)  the  relations 

Xj(t)  =  -  Mjj(c  +  tq)  +  M2j(bj  +  tpj) 

*  hlj  +  h2j 

and 


-  Mljq  +  M2jPj 

-  H3jq  +  M4jPj 


(3.4) 


vj(t)  =  "  M3j(ctt<t)  +  H4j(bj  +  tpj)  I3'5) 

1  «1J  +  (‘"‘j)  03j  • 

Substituting  x.(t)  into  (3.2)  we  have,  for  i=v+l,...,m  ,  the  inequality 

ai  hlj  +  ai  h2j  -  (b)i  +  (P)  i  +  ( t  -  )  (p)  i  (3.6) 

or 

(t-t,)(a;  Ky-(p),)  <  (b),  t  tjfp),  -  a;  hy  . 

Therefore,  x.(t)  is  a  feasible  solution  for  all  t  >  0  for  which  these 
inequalities  are  satisfied. 


Because  hj.  =  Xj(ts)  ,  it  follows  from  (3.2)  that 
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(3.7) 


(b)f  +  tj(p).  -  a)  hjj  >  0  ,  i=v+l, . . . ,m 
If  (ai  h2j  "  (p)i)  “  0  *  i=v+1»---»m  *  set  tj+i  =  ,JO  »  otherwise  set 

v  -  tj  -  -{ (b) i  »;•  *  -  (P)«  >  ° }  ,»■ 


a;  h2j  -  (P), 


a;  h2j  -  (p),  >  0  >  (3.8) 


and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained. 


Because  of  (3.7)  we  have  t*+1  >  t.  .  Define  the  set  1^  of  critical 
indices  as  follows 


!lj  *  I1  |(b>i  +tJ(p)i  ”ai,hlj  =  0  and  ai  h2j  -  (p>i  >0)  • 

Clearly,  t*+1  >  tj  if  and  only  if  1^  =  0. 

If  1^  4=  0  ,  then  Xj(t)  ,  as  defined  by  (3.4),  is  not  feasible  for 
any  t  >  t.  .  Thus  at  least  one  of  the  secondary  active  constraints  must  be¬ 
come  a  primary  active  constraint.  We  choose  the  constraint  with  index 


k  =  min  |i  |  iel1:j  f  . 

The  computation  of  the  new  matrix  M.  j  is  discussed  below. 

Suppose  now  that  Ij.  =  0  and  observe  that  by  (3.3)  we  have 


(3.9) 


(3.10) 


If  g„.  i  0  ,  then  v.(t)  S  0  for  all  t  5  t.  .  In  this  case  we  set 


tj+j  =  *,  otherwise  set 


Vi  ‘  =  m,n 


(g?.)  <  0  } 


(3.11) 


and  let  1  be  the  smallest  index  for  which  the  minimum  is  attained.  Because  of 


(3.10),  tj+1  >  ^  .  With 


Ioj  =  {  1  |  (g1j)i  =  0  and  (q2-)i  <  o  } 
it  follows  immediately  that  t  • , >  t-  if  and  only  if  I0-  =  0  . 
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If  1 2 j  *  0  ,  then  Xj(t)  is  not  optimal  for  any  t  >  tj  .  Thus  at 
least  one  of  the  primary  active  constraints  must  become  a  secondary  active 
constraint.  We  choose  the  constraint  with  index 


(3.1?) 


1  =  min  {  i  i  €  I7.  f  . 

L  1  '•J  , 


The  new  matrix  is  derived  below. 

Set  =  0  .  In  order  for  xj(t)  to  be  an  optimal  solution  t:  (2.1) 
both  the  inequalities  (3.6)  and  (3.5)  have  to  be  satisfied.  Thus  we  set 

r  *  ~  i 

t.  .  =  min  <  tjAl  ,  t<Al  ,*  . 


I  UJ+1  ’  M+l 


Then  the  following  lemma  holds. 


Lemma  3 


There  is  t.+j  >  t.  such  that 

i)  Xj(t)  =  ^ij  +  (t-tj)hgj  is  an  optimal  solution  to  (2.1) 
for  all  t  with  t .  s  t  <  tj+j  . 

ii)  There  is  no  t  >  t  ■  j  such  that  x^(t)  is  an  ootimal  so¬ 
lution  to  (2.1)  for  t  =  t  . 

iii)  t.+j  >  t.  if  and  only  if  1^  U  I,.  =  0  . 

We  now  discuss  the  computation  of  the  new  matrix  M.  ,  . 


Case  1: 


Either  Ijj  *  0  or  1^  =  I?j  =  0  and  tj4>1  =  t*+]  . 


the  constraint 


In  either  case 


ak  x  -  (b)k  +  b(P)k 


(3.13) 


has  to  be  added  to  the  set  of  primary  active  constraints,  ""hare  are  two  cases 
depending  on  whether  is  an  element  of  span  {  a, , . . .  ,av,  '•  or  not.  In 

order  to  decide  which  case  applies  we  consider  the  equations 


-  q  - 


from  which  we  obtain 


w  =  Mljak  ,  z  -  M3ak  . 


(3.14) 


Clearly,  ak  €  span  {  a^,. . . ,a  1  if  and  only  if  w  =  0  . 


First  assume  that  ak  $  span  {  a^,. . . ,av  }  .  In  this  case  we  set 

Aj+1  =  (Aj  ’  ak^ 


and 


'  C  •  Aj+1 


\Aj+l  1 


0 


Since  the  columns  of  Ai+^  are  linearly  independent  it  follows  from  Lemma  2 
that  M.+j  is  nonsingular. 


Next  assume  that  w  =  0  .  Since  in  this  case  the  vectors  a,,...,a^,ak 
are  linearly  dependent  we  have  to  determine  a  constraint 


a^  x  <  (b)1  +  t(p)1 


in  the  set  cf  primary  active  constraints  which  will  be  replaced  by  (3.13). 
This  can  oe  done  by  using  the  vector  z  as  defined  by  (3.14).  If  z  <  0  , 
it  follows  from  Lemma  6  in  the  next  section  that  (2.1)  has  no  feasible  solu¬ 
tion  for  t  >  t-  .  If  z  has  at  least  one  positive  comnonent  let  the  set 

J 

!,j  be  defined  such  that  i  €  I ^ j  if  and  only  if 


M 

(z)i 


mi  n 


jVv 

(z)%l 


(z)„  >  o 


and  set 


m  n 


r  . 

i1 


i  e  I 


3j 


It  is  not  difficult  to  verify  that  with  this  choice  of  1  the  nradients 
of  the  new  set  of  primary  active  constraints  are  linearly  independent  and  that 

there  are  ^  tr  0  such  that 


-  (c  +  tj  q-CXj(tj))  =  z  X.a.  +xkak  . 

i*l 


Furthermore,  if 
choosing  k  and 


Ijj  *  0  it  follows  from  Lemma  7  that  the  above  rules  for 
1  ensure  the  existence  of  an  >  j  such  that  Ijj  =  0  . 


Case  2: 

Either  ly  -  »  ,  ly  »  0  or  !y  =  Iy  *  0  and  tj+1  -  tj+1  <  t*+1  . 
In  either  case  the  constraint 

a|  x  £  (b)-|  +  t ( q ) i 


has  to  be  deleted  from  the  set  of  primary  active  constraints.  If  C  is  not 
positive  definite  in  the  set 


at  x  *  0 


1=1 . v 


i  *  1 


(3.15) 


or  if  there  are  secondary  active  constraints  at  x.(t.)  it  may  be  necessary 

J  J 

to  add  a  constraint 


aj,x  s  (b)k  +  t(q)k 


to  the  set  of  primary  active  constraints.  In  order  to  decide  this  we  denote 
the  1-th  column  of  M0.  by  s-,  and  the  element  in  the  1-th  row  and  1-th 

<-j  i 

column  of  •  by  to  .  Then  it  follows  from  Lemma  4  that  C  is  positive 
definite  in  the  set  (3.15)  if  and  only  if  to  <  0  .  Furthermore,  if  to  <  0  , 
then 


Xj(t)  =  c0(t-tJ.)s1  =  hlj  +  (t_  "  Vd  (3-16) 


is  the  unique  optimal  solution  to  the  problem 


mi  n 


(c  +  tq) 1  x  +  x‘  C  x  |  a  I  x  =  (b) ^  +  t(p) .  ,  i  =  l,. . .  ,v  ,  i  *  1  j  , 
_  (92j)1 


where  1  =  — 1  and  n„ .  is  the  vector  used  in  (3.5).  If  there  are  second- 

o  'jl>  2  j 

ary  active  constraints  at  x.(t.)  ,  (".16)  need  not  be  a  feasible  solution  to 

o  d 

(2.1)  for  any  t  >  t-  .  Therefore,  we  define  the  set 

J 


4j 


1  a;.  Sj  < 


and  a;  hj.  =  (b)<  +  t,(p)i  > 


11 


and,  if  1^.  *  0  ,  the  number 


Tq  =  ™ 


r  (p)i  ~  di  h2j  .  T  i 

in  {  ——  |  i  e  I4j  }  • 


ai  S1 


If  a  <t  ,  then  (3.16)  will  be  a  feasible  solution  to  (2.1)  for  t  >  t, 

0  0  J 

sufficiently  smal 1 . 

Therefore,  if  w  <  0  and  cr  <  x  no  new  primary  active  constraint  is 

0  0 

needed.  If  cu  <  0  and  °0  ^  T0  »  then  a  secondary  active  constraint  will 
become  a  primary  active  constraint.  Finally,  if  w  >  0  and  I^.  =  0  then 
the  problem 

min  |  (c  +  tq) ' x  +  y  x' C  x  a}  x  =  (b)^  +  t(p. )  ,  i  =  l, . . .  ,v  ,  i  *  1  j 

has  no  optimal  solution  for  t  >  t •  (see  the  proof  of  Lemma  6).  In  this  case 
either  (2.1)  has  no  optimal  solution  for  t  >  t-  or  there  is  some  x^  >  0 
and  some  index  k  such  that  a^s^<  0  , 

xj<V  ‘  Tisi 

is  an  optimal  solution  to  (2.1)  and  xj ( tj )  "  Ti  ak  si  =  (b)^  +  t ^ ( p ) ^  , 
where  and  k  are  determined  by  inserting  x.(tj)  ~  1  s\  into  the 
i nequal i ties 

ai  x  <  (b).  +  t(p)1-  ,  i=v+l,...,m 

which  are  not  active  at  Xj(tj)  and  computing  the  largest  value  of  x  for 
which  Xj(tj)  -  t  s^  is  feasible.  Details  of  this  procedure  are  given  in 
Step  3.3  of  the  algorithm  described  in  the  next  section. 


It  follows  from  Lemma  9  that  the  above  rules  for  changing  the  set  of 
primary  active  constraints  ensure  the  existence  of  an  >  j  such  that 
I^,  =  0  ,  v  =  j,  ]+!,...,  .jj  ,  and  I2u  =  0  . 


4.  An  algorithm  for  solving  parametric  linear  and  quadratic  programming 
problems 


In  this  section  we  describe  an  algorithm  for  computing  the  ootimal 
solution  to  problem  (2.1)  as  an  explicit  function  of  the  parameter  t  . 

It  is  assumed  that,  for  t  =  _t  ,  the  algorithm  starts  with  an  optimal  solu- 
tion  x  (t)  to  problem  (2.1)  which  has  the  properties  described  in  Lemma  2.1 


A  general  cycle  of  the  algorithm  consists  of  four  steps.  At  the  begin¬ 
ning  of  the  j-th  cycle  the  following  data  are  available: 


MT1 

J 


'  H2j  ' 


K3j  '  %  I 


hlj  '  h2j  ’  qlj  ’ 


g2j  •  J(xj>  and  vj  ■ 


Here  v-  denotes  the  number  of  primary  active  constraints.  The  elements 

J 


a.,  of  the  index  set  J(x.)  are  positive  integers  and  are  defined  in  such  a 

I  J  sj 


way  that  a^j  =  k  if  and  only  if  the  i-th  column  of  the  matrix  Aj  is  equal 


to 


the  gradient  of  a  primary  active  constraint.  Then 


lc  ,  Aj\ 


and 


\V  0 


/hlj) 

\gljj 

J 

\ 

,h2j\ 

II 

3 

» - ' 

\’2j/ 

J  l 

b3  +  “j 


where  bj  and  p.  are  appropriate  subvectors  of 


b  and  p  ,  respectively. 


In  Step  1.1  and  Sten  1.2  the  critical  sets  I j  .  and  I„.  are  deter¬ 
mined  which  contain  the  indices  of  secondary  active  constraints  which  are  not 

satisfied  for  t  >  t-  and  multipliers  which  are  neoative  for  t  >  t-  ,  re- 

J  J 

spectively.  If  both  sets  are  empty  Step  3.1  is  used  to  compute  the  maximal 

tj+j  >  t.  such  that 

Xj(t)  ■  hu  Mt-tjlSj 
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is  an  optimal  solution  to  problem  (2.1)  for  t.  <  t  <  t-  ,  . 

J  J  ^ 

In  Step  2  it  is  determined  whether  a^  ,  the  gradient  of  the  con¬ 
straint  that  becomes  a  new  primary  active  constraint,  is  linearly  dependent 
on  the  gradients  of  the  present  set  of  primary  active  constraints.  If  this 
is  the  case  then  a  constraint  is  selected  which  has  to  be  deleted  from  the 
set  of  primary  active  constraints. 

In  Step  3  a  constraint  a^x<(b)^+t(p)^  is  given  which  will  be 
dropped  from  the  set  of  primary  active  constraints.  If  the  problem 

min  |  (c  +  tq)'x  +  ^  x'C  x  j  al  x  =  (b)i  +  t(p)i  ,  i  fc  J(Xj)  -  {1}  j 

has  a  unique  optimal  solution  which  satisfies  the  inequalities  Ax  <  b  +  tp 
for  t  >  t.^  sufficiently  small,  then  no  new  primary  active  constraint  is 
required;  otherwise  a  constraint  is  determined  that  will  be  added  to  the  set 
of  primary  active  constraints. 

In  Steo  4,  the  matrices  A.  ,  and  M.*,  are  computed. 

J  ”  ^  J  ^ 

Next  we  give  a  detailed  description  of  a  general  cycle  of  the  algorithm. 


Step  1 
1.1 


Define  the  set  1^  such  that  i  e  I ^  •  if  and  only  if 
(b)f  +  tj(p)i  -  ai  hjj  =  0  and  a}  h2j  -  (p).  >  0 
If  Ij.  =  0  go  to  SteD  1.2;  otherwise  set 
k  =  min  |  i 
and  go  to  Step  2. 


1  • 


Vi  ■  ‘j 


1.2  Sefine  the  set  I-.  such  that  i  €  I-. 


if  and  only  if 


Vi  *  ° 


and 


If  I2j  =  0  go  to  Step  1.3;  otherwise  set 


.  .  f 

1  •-  min  < 

and  qo  to  Step  3.1. 


i  e  I 


(n2j)i  <0 

t 

1 


5+1  = 
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1.3  If  h2j  •  (p).j  ^0  for  i  =  l,...,m  set  tj+^  *  t j  *  »  ,  otherwise 


set 

*j+l  -  tj  =  min 


r  <b>i  *  yp>i  -  ai  hij 


aih2j  -  (p),  >0 


ai  h2j  '  (p>i 

and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained. 
If  92j  2  0  set  tj+i  "  t-  =  °°  ,  otherwise  set 


Vi  -  4j  ■  min 


{ — y-J- 1  (s2j)1  <  o } 


and  let  1  be  the  smallest  index  for  which  the  minimum  is  attained. 
Set 

*j+i  5  *rtn  { ‘j*i •  Vi} 

and  print 

Vl  •  hlj  and  h2j  • 

If  tj+j  >  t  stop;  otherwise  do  the  following.  If  tj+^  =  tj+j  gQ 
to  Step  2.  If  tj+j  =  tj+^  <  tj+j  go  to  Step  3.1. 


Step  2 


Compute 


"  *  Muak 


If  w  *  0  go  to  Step  4.1,  otherwise  compute 

z  *  n3j  ak  ' 

If  z  <  0  stop  with  the  message  that  the  problem  (2.1)  has  no  feasible 
solution  for  t  >  t.+j  .  If  z  has  at  least  one  positive  component 
define  the  set  I^j  such  that  i  £  I^j  if  and  only  if 

_y_  .  |  |  (2)  ( >  o  [  . 


=  mi  n 


(z)i 


(*>, 


Set 


mi  n 


1  £  !3j  } 


and  oo  to  Sten  4.3. 
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and 


Step  3 

3.1  Set  s |  =  ( ^2 j ) 1  ’  ^  =  (^4j)ll  * 

I4j  =  {i  |a;5l  <0  and  .;hy  =  (b),  +  tjtp),  }  . 

If  =  0  and  cj  =  0  ,  go  to  Step  3.3. 

If  1 4 j  =  0  and  cj  *  0  ,  go  to  Step  4.2. 

If  *  0  ,  compute 


t0  =  min 


'■{ 


C>i  -  M  h;j 

-  aisl 


i  €  I 


4j  } 


and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained. 
If  tq  >  0  ,  go  to  Step  3.2;  otherwise  compute 

»  ■  Mij\  ■ 

If  w  *  0  ,  go  to  Step  4.1;  otherwise  go  to  Step  4.3. 


3.2  If  cj  *  0  and 


(g2j)l 


<  tq  ,  go  to  Step  4.2;  otherwise  go  to  Step  4.3. 


3.3  Set 


!5j  =  i1'  I  ai  si  <  0  and  ai  hij  <  (b)i  +  tj(P)i  t 


If  Ig-  =  0  ,  stop  with  the  message  that  there  is  no  optimal  solution 
for  t  >  tj+j  .  If  Ig.  *  0  ,  compute 


=  min 


(tpj  +  tj(p)1  -  a;.hlj 


aisl 


i  e  ICJ 


5J  f 


and  set 


1  e  *SJ 


(b),  t  tj(p),  -  a;hu  1 
1  ■  .  .  !  • 


ai  S1 


Compute 


=  min 


1eI  \ 

-  *•  r  OJ 


-  ai  Sj 


and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained.  Go 
to  Step  4.3. 
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1 


4.1:  Set  vjtl  =  vj+l  and  Jj*l  -  . 

ai,j+l  =  “tj  ’  i=1 . vj  '  \J+1,j+l  =  k  ■ 

Go  to  Step  4.4. 


4.2:  Set  vJ+1  =  Mj  -  1  and  Jjt,  =  <a1>j+1,. 


a. 


i.j+l  "  i j 


=  a,  .  , 


i=l,. ..,1-1 


a. 


i,j+l  l+l , j  ,  i=l ,. . . ,v .-1  . 


Go  to  Step  4.4. 


4.3:  Set  vJ+1  .  Vj  and  Jj+1  -  . n ,*,)  . 


al,j+l  = 

Go  to  Step  4.4. 


i.j+l  ij  * 

k  . 


j+r 

i  —  1 , .  • . » v .  j  i  *  1 


4.4:  Set 


A* 

j+i 


v  UJ  +  1  Vj  +  l’J  +  1 


bj+i 


(b). 


‘l,j+l 


.....(b). 


J+1’J+1, 


j+1 


(p) 


l,j+l 


,...,(P) 


j+1 


,  j+1 


MJ+1 


C  ’Aj+1 
Aj+1  ’  0 


-iii 


Kl,j+1  '  "2 
'*3,3+1  '  M4 


,  where 


,  where 


where 


,  j+1  / 
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'l.j+l 


’  M2,j+1 


92,j  +  1  /  \  3,j+l  *  M4,j+1  /  \bj+l  +  Vl  pj+l 


•  C  '  Vl9 


h2,j  +  l 


Ml,j+1  •  M2,j+l' 


\92, j  +  1  /  \3,j  +  l  *  M4,j+1  /  \Pj+l/ 

Replace  j  with  j+1  and  go  to  Step  1.1. 


In  the  following  we  prove  some  lemmas  which  establish  the  basic  prop¬ 
erties  of  the  algorithm.  The  first  two  lemmas  are  concerned  with  the  exist¬ 
ence  of  M.  . 


Lemma  4 


Let  s^  =  (^2j)i  and  w  =  (M4-)]i  be  defined  as  in  Step  3.1  of  the 
algorithm  and  assume  that 


1  C  x  >  0  for 

x  *  0  > 

x  €  |x  |  ai  x  = 

Then 

x1  C  x  >  0  for 

x  *  0  , 

x  e  T  =  |  x  a  I  x 

if  and  only  if 

o 

V 

o 

• 

If  .  <  0  set 

■o  ■  < 

9p  .)i  /  u  .  Then 

xj(t) 

-  °o(t-tJ+l)sl 

is  the  unique  optimal  solution  to  the  problem 

mi n  |  ( c  +  tq ) 1  x  +  -i  x 1 C  x  a  \  x  =  ( b ) .  +  t(p)..  ,  i  €  <J .  -  ;  1 }  j  .  (4.1) 


Proof: 


Set  Sj  =  •  Then 

Csl  +  ^  s2  =  0  ’  a;  Sj  =  0  , 

al  s,  =  1  . 


i  e  j,  -  n ' 


Thus 


U)  . 


(4.2) 


slCsl  =  -  S1  Aj  s2  =  -  ^s2^1  =  ‘  ^M4j^l  = 

Let  x  £  T  and  x  4=  0  .  Then  there  are  X  and  y  such  that  A \  y  =  0 
and  x  =  y  +  XSj  .  Therefore, 

x'Cx  =  y'  Cy  +  2  X  s^  Cy  +  X2  s^  C  Sj  (4.3) 

=  y'  Cy  +  X2s|CSj  , 

because  s^ C y  =  -  s^  Aj  y  =  0  .  Since  Sj  £  T  ,  the  first  part  of  the  lemma 
follows  from  (4.2)  and  (4.3). 

In  order  to  prove  the  second  part  of  the  lemma  we  first  observe  that 
a-(Xj(t)  -  oQ(t-  tj+1)Si)  =  (b)i  +  t(p)i  ,  l€Jj  -  {1}  . 
Furthermore, 

Cx.(t)  +  A'.v.(t)  =  -  (c  +  tq)  (4.4) 

J  J  J 

with  (vj(tj+i))1  ■  0  .  Thus 

C[Xj(t)  -  Vt_tj+l)Sl3  +  Aj[VJ(t)  +  0o(t‘tj+l)S2]  =  "  (c  +  tq)  (4*5) 
and 

<Vj(t>  +  o0(t- VPSj),  -  *  It-tj,lU92j+O0S2)! 

*  * ’,ol-s:h'1  °  0  • 

Therefore,  it  follows  from  (4.4),  (4.5)  and  the  Kuhn-Tucker-conditions  that 
x  (t)  -  o(t-  ‘tj+i)si  is  an  optimal  solution  to  (4.1).  By  the  first  part  of 
the  lemma  it  is  the  unique  optimal  solution. 

lemma  5 

If  M  is  a  nonsingular  matrix,  then  every  matrix 


determined  by  the>  algorithm  is  nonsingular. 
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Proof: 

Suppose  that,  for  some  j  ,  M.  is  nonsingular.  Because  of  Lemma  2  we 

J 

know  that  then  the  columns  of  A',  are  linearly  independent  and  x'Cx  >  0 
for  every  x  *  0  wi th 

,fii  ■  H v  =  °}  ■ 

Similarly,  it  follows  from  Lemma  2  that  is  nonsingular  if  the  columns 

of  are  linearly  independent  and  x'Cx  >  0  for  every  x  *  0  with 


x  e  T. 


x  A.tlx  =  0 


Without  loss  of  generality  we  may  assume  that 


Aj  =  (al’---’av)  • 

First  assume  that  Step  2  of  the  algorithm  is  used  in  the  j-th  cycle.  Then 


MU  *  MZJ 

M3j  ’  M4j 


Mlj  ak 
M3j  ak 


Cw  +  A'  z  =  ak  . 
If  w  *  0  ,  then  AL  j  =  (a^. . .  ,a^,ak) 


If  w  =  0  ,  then  Ai+1  =  (a^ . . .  ,a1.1,ak,a1+1>. . .  .aJ  with  (z)1  *  0  . 

In  both  cases  it  follows  immediately  that  the  columns  of  A*.  .  are  linearly 

J  ^ 

independent.  Furthermore,  x1  C  x  >  0  for  every  x  *  0  with  x  €  Tj+^ 


because  T.  ,  c  T, 

J  ^  "  **  0 


Next  assume  that  Step  3  of  the  algorithm  is  used  in  the  j-th  cycle.  If 
Aj+1  =  (a1,...,a1_1,a1+1,...,av) 

then  ^  *  0  .  The  columns  of  Ai+^  are  linearly  independent  and  it  follows 
f^on  Lemma  4  that  x'  C  x  >  0  for  x  *  0  ,  x  G  Tj+^  .  If 

Aj+1  =  (ai* —  *al-l’ak’al+l* — ,a.) 


then  ak  s^  <  0  . 
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Since  a^  s^  =  0  ,  i=l,...,v  ,  i  *  1  ,  the  columns  of  Ai+^  are  linearly 

independent.  Furthermore, 


x  £ 


Ti  - 


ai  x  =  0 


i  *  1 


and  x1  C  x  =  0  imply  x  =  XSj  for  some  X  .  Since  =  T.  n  {x'aj)x  =  0> 

and  aj^  Sj  <0  the  vector  s^  is  not  an  element  of  T.+^  .  Thus  x  €  Tj+1 
and  x  *  0  imply  x'  C  x  >  0  . 


The  next  lemma  shows  that  the  termination  of  the  algorithm  with  Step  2 
or  3  implies  that  tie  given  problem  has  no  optimal  solution  for  t  >  t^+^  . 


Lemma  6 


i)  If  the  algorithm  terminates  with  Step  2  in  the  j-th  cycle,  then 
the  problem  (2.1)  has  no  feasible  solution  for  any  t  >  t.+j  . 

ii)  If  the  algorithm  terminates  with  SteD  3  in  the  j-th  cycle,  then 
the  problem  (2.1)  has  no  optimal  solution  for  any  t  >  tj+j  . 


Proof : 

i)  We  have  a^  =  /U  z  ,  z  <  0  and,  by  the  definition  of  k 

ak  hlj  ■  <b>k  *  WP)k  •  ak  h2j  >  <!»k  • 

Let  t  >  t-  ,  and  A.  x  <  b.  +  t,  p.  +  (t-  t^)  p.  .  Then 

^  J  J  J  J  J  J 


and 


Therefore, 


Vx-hu-(t- Vhzj> s0 

ak^hlj  "  (t  ‘  V  h?j)  >  (b)|<  +  (P)r  +  ( t  -  t j )  ( P ) k  • 

akx  =  ak(hlj  '  (*“  tjOby)  +  z'Aj(x"  hij  '  (t_tj)h2j) 
>  (b)k  +  tj(p)k  +  (t‘tj)(P)k  • 


ii)  Without  loss  of  generality  we  may  assume  that  Ai  =  (a^,...,aM)  and  1  =■ 
By  the  definition  of  1  we  have 


(vj(tj+1))1  =  0  and  (g2j)1  <  0 


1 


t  >  tj+j  ,  we  have 


or 


Furthermore,  let  and  s,  be  defined  as  in  the  proof  of  Lemma  4.  Then 

sjCsj  =  -  u  =  0. 

Because  C  is  positive  semidefinite  this  implies  C  s^  =  0  .  Thus  for  any 

S 1  C  x j ( t )  +  Aj  v j ( t )  =  -  s^(c  +  tq) 

-  s^(c  + 1 q )  =  (Vj(t))1  =  (g1j)1  +  (t- tj  +  1)(g2j)1  <0  . 

Furthermore,  since  =  0  and  1^  =  0  it  follows  that  a!  s^  >  0  for 

i=l,...,m  .  Therefore,  if  for  any  t  > ,  there  is  a  feasible  solution 
x  ,  say,  then 

a !  ( x  -  or  s  ^ )  <  ( b )  ^  -J-  t  ( p )  •  for  all  o  >  0 

and  i=l,...,m  .  Moreover, 

(c  +  tq)'(x-os1)  +  ^  (x-asj)'  C(x-aSj)  = 

A  1  /V 

(c  +  tq)lx+Yx’Cx-a(c  +  tq)'s^-°°  as 


The  main  difficulty  in  showing  the  finite  termination  of  the  algorithm 


is  to  prove  that  for  every  j  for  which  the  union  of  the  critical  sets  I 


lj 


and  Ipj  is  not  the  empty  set  there  is  some  j  j  >  0  such  that  I ^  ■  u  I^j  =0 
This  is  done  in  the  following  three  lemmas.  *  * 


Lemma  7 


For  every  jQ  with  I ^  *  0  there  is  jj  >  j'0  with  Ijj  =  0  . 

Proof: 

There  is  a  largest  integer  j*  >  j  with 


and 


!lj  *  0  ’  J=VJ*o+1’“”j 


ak  t  span  |  a.  |  i  e  J(  x^*)  j-  , 


vhere  k  is  the  index  determined  in  Step  1.1  of  the  algorithm.  Set  j  =  j  +  1 


2?  - 


and  let  D  be  any  matrix  such  that  (At  ,D')  is  a  nonsingular  (n,n)-matrix 
and  every  column  of  D'  is  orthogonal  to  all  columns  of  At  .  Define  the 

J 

set  of  integers  I  in  such  a  way  that  i  €  I  if  and  only  if 


and 


a;  x.ftj)  =  (b).  +  tj(p)i 

a.  e  span  j  ai  i  €  J(Xj)  }  . 


(4.6) 


(4.7) 


Finally  choose  any  t  >  tj  and  consider  the  following  linear  programming 
problem 


max 


|(bj  +  tpj)'  v  +  ^  ((b)i  +  t(p)i)A. 


subject  to  the  constraints 

Aj  v  +  Dy  +  Z  ai  Xi  =  -  (c  + q)  -  C  x^(tj) 


v  >  0  ,  Xi  >  0  ,  i  e  I  . 


We  will  apply  the  simplex  method  with  Bland's  [1]  minimum  index  rule  to 
this  problem. 


First  we  observe  that  (Aj  ,  D)  is  a  basis  matrix  for  this  problem.  The 
correspondi ng  basic  solution  is  v  =  v.(t- )  ,  y  =  0  .  In  order  to  determine 
the  new  basic  variable  we  compute 


x 


(bj  +  tpj} 


and 

yi  =  (b)i  +  t(p)i  -  al  x  ,  i  €  I  . 


If  ct-  >  0  for  all  i  e  I  ,  then  the  current  basic  solution  is  optimal.  If 
at  least  one  t.  is  negative,  then  \  will  become  the  new  basic  variable, 
where 


r 

k  =  mi  n  «,  i  €  I 


(4.8) 


Because 
we  have 


Aj(x  -  xj(t))  - 


and  x  •  ( t)  are  solutions  to  tho  equations  A  .  x  =  b  .  +  t  P  •  , 
i  J  j  J 

Thjs  it  follows  from  i4.7)  that 
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(4.9) 


ai  =  (b)i  +  t(p).  -  al  Xj ( t)  ,  i  €  I  . 


Since 


Xj(t)  =  hy  *  (t-tj)hy 

a.  hy  -  (p),  >  0 


we  deduce  from  (4.6)  and  (4.9)  that 
for  every  i  €  I  with  a.-  <  0  . 


Therefore,  every  i  e  I  with  a.  <  0  is  an  element  of  the  set  1^  .  Since 
by  the  definition  of  j  ,  the  index  k  determined  in  Step  1.1  of  the 
algorithm  is  an  element  of  the  set  I  ,  it  is  identical  with  the  k  selected 
by  (4.8). 


In  order  to  determine  the  basic  variable  that  will  leave  the  basis  we 
compute 

/ 

l  =  a. 

j 


(A;.  ,  D'f1  ak  . 


From  (4.7)  we  deduce  that  =  0  and  y^  =  z  ,  where  z  =  a^  is  the 
vector  determined  in  Step  2.1  of  the  algorithm  as  part  of  the  solution  to  the 
equations 

C  w  +  A',  z  =  a, 


J 


A  •  w 

J 


‘k 
0  . 


Defining  the  set  I  such  that  i  €  I  if  and  only  if 


— * — * — L  =  min  -J  — * — ± — - 


(z)i 


<z>v 


z  >0 

V 


we  obtain  the  index  of  the  basic  variable  that  will  leave  the  basis  as  follows 

1  =  min  |  i  €  I  j  . 

This  index  is  the  same  as  the  one  determined  in  Step  2  of  the  aleorithm. 


The  above  results  show  that,  for  j  =  j*  +  1  ,  I..  =  0  if  and  only  if 

v  =  vj(tj)  »  y  =  Q  Is  an  optimal  basic  solution  to  a  linear  maximization 
problem.  If  1^  *  0  ,  then  (A'.+|  ,  D' )  is  the  basis  matrix  obtained  by 
performing  one  iteration  in  the  simplex  method.  The  corresponding  basic 
solution  is  optimal  if  and  only  if  \?  •  j  =  0  .  Repeating  this  argument  and 
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observing  that  by  Bland's  rule  the  simplex  methods  determines  on  optimal 

solution  in  a  finite  number  of  iterations  we  deduce  that  there  is  >  jQ 

with  lu  =  0  . 

1J1 


Lemma  8 


For  every  j  ,  1^.  =  0  and  *  0  imply  1 1 , j+l  =  ®  • 


Proof: 


Let  Sj  =  (M2j)1  and  s2  *  (M4j ) i  •  Then  (si  >  s2)  satisfies  the  equations 


4j 

C  S1  +  ^  s2 

A.si 


(4.10) 


=  e. 


where  (e.)^  *  0  ,  i  *  1  ,  and  ( e j ) ^  =  1  . 

Furthermore, 

xj<t>  ■  hu  *  •  vj(t>  5  9ij  *  (t-tj>92j 

are  determined  as  the  unique  solution  to  the  equations 

Cx  +  A!jV  =  -  (c  +  t  q) 

J 


aj  x 


■  bj  +  1  pj  • 


Without  loss  of  generality  we  can  assume  that 

Aj  =  {ava2,.. .  ,av)  and  1  =  v 

Then 

V/  f  +■  \  —  U  A-  /+-  —  •. 

j+l;  2,j+l 


xj+l(t)  =  hl,j+l  +  (t-tu1)h9  u 


Vl(t)  =  gl,j+l  +  (t'tj+1^2,j+l 

is  the  unique  solution  to  the  equations 

c x  +  Aj+1#  '  -  <cttp> 


Aj*lx 


Vl  +  1  pj*l  • 


(4.11) 


where  A^+1  =  (a^. . .  ,axl_j)  or  A^+1  =  (a1,...av,a|<)  or  A^+1  =  (a1 , . .  .a,,_1  ,ak) 

denendinq  on  which  part  of  Step  3  of  the  algorithm  applies.  Because  I2j  *  0  we 

have  t.  ,  =  t-  . 

,/  +  l  J 
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Case  1: 


Uj  *  0  and  To  =  0  • 

Since  ak  h2j  '  (P)|<  =  0  ’  follows  that 

ak  Xj ( t)  =  (b)k  +  t(p)k  +  (t  -  tj  )(p)k  (4.12) 

for  all  t  . 

If  Mjj  ak  *  0  ,  then  A^.+1  =  (Aj  ,  ak)  and  it  follows  from  (4.12)  that 

x-j(t)  ,  (Vj(t)  ,  0) 

is  a  solution  to  (4.11).  Thus  Xj+1(t)  =  xj(t)  .  If  i  is  the  index  of  a 
secondary  active  constraint,  we  have,  therefore, 


i-e-  m  0 


Then 


ai  h2,j+l 

1 

-  (P),  * 

ai  h2j 

-  (P) 

i  <0 

that 

ak  ■  0  ' 

Then 

Ak  ■ 

(ar 

z  =  My  a 

k  .  Since 

(z)l 

■  z'Ao 

S1  = 

( ^1  j )  i 

(9ljh 

(z)i 

(z)i  . 

i =1 » 

<Slj)l  * 

(9ij>i 

<2>1 

(Sy),  - 

{92jh 

(z)l 

(z)1  , 

1-1. 

(iy)l  * 

<32j>l 

(2), 

*  Sj 

Vj(t>  ' 

~Vj(t)  « 

/V 

!  9lj + 

(t- 

(4.13) 


Therefore,  it  follows  from  (4.12)  and  (4.13)  that  Xj(t)  »  Vj(t)  is  a  solu¬ 
tion  to  (4.11).  Thus 


-  - 


Xj+1(t)  =  Xj(t)  (4.14) 

and  -  0  . 

Case  2: 

(1^  =  0  and  co  *  0)  or  (I^j  *  0  ,  x0  >  0  ,  co  *  0  ,  and 
( 9 2 j ) ■]  /  co  <  t)  . 

In  this  case  we  have  Aj+^  =  (a^, . . . »ay_^)  .  With 
( 9  2  “? )  i 

°o  =  •  w  =  =  (s2)l 

CO 

we  have 

(vJ(t))1  -  <?0(t- tj)(s2)1  =  (t- tj.)((g2j.)1  -  o0(s2)1)  =  0. 

Let  Vj(t)  and  $2  denote  the  vectors  obtained  from  Vj(t)  and  s2  . 
respectively,  by  deleting  the  1-th  component.  Then 

Xj(t>  -  ,  jj<t)  -  o0(t-tj);2 

satisfy  the  equations  (4.11).  Indeed, 

Vi  xj(t)  ‘  =  Vixj(t)  ■  bo>i +  tpo>i 

and 

C  [  Xj(t)  -  o0(t-t.)Sl  ]  +  AJ+1  [  Vj(t)  -  aQ(t-  tj)  s2  ]  = 

C  +  ao(t  "  VAj  s2  +  Aj  [  vj(^  '  3o(t'  ty  s2  ] 

C  Xj(t)  +  Aj  Vj(t)  =  -  (c  +  tq)  . 

By  Lemma  4  we  have,  therefore,  ( t )  =  x ^ ( t )  -  xo(t-  tj)  5^  which  implies 

hl,j+l  =  hlj  and  h2, j+1  =  h2j  "  °osl  '  (4,15) 

Furthermore,  ( 92j )  1  <(^  and 

to  =  (s2)1  =  Aj  s2  =  -SjCSj<0  (4.16) 

imply  =  (g2j)1  /  .  >  °  . 
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Now  let  i  be  the  index  of  any  secondary  active  constraint.  If 
a}  Sj  >  0  ,  then 

a1  h2,j+l  -  <p>i  *  ai  h2j  •  (p)i  ■  °0  ai  S1 
<  a'.  h2j.  -  (p)^  <  o  . 

If  a'.  Sj  <  0  ,  then  i  e  I4j  and 

ai  h2,jtl  '  (p)i  =  ai  h2j  '  (p)i  '  °o  3i  S1 

,  /'(P>i-aih2j  .  \ 

-  ais4— 


s  ai  S1  <To  "  °o)  <  0  • 


Therefore,  *i,j+l  =  ^  • 


Case  3: 

(I4j  *  0  ,  T0  >  0  ,  u>  =  0)  or  (I4j  *  0  ,  T0  >  0  ,  u  *  o  ,  and 
(g2j)l  /  a)  >  tq)  • 

In  this  case  Ai+1  =  (a^. . .  ,av_rak)  .  With  the  same  arguments  as  in 
the  previous  section  it  can  be  shown  that  Xj+^(t)  =  xj(t)  '  To^t-^j^sl  ’  1,1 

"l,j+l  ■  hlj  and  h2,j*l  =  h2j  '  To  S1  •  (4'17) 

Let  i  be  the  index  of  a  secondary  active  constraint.  If  ai  s1  >  0  ,  then 

ai  p2,j+l  •  <p>i  =  a5  h2j  •  (p)i  ■  To  ai  51 


<  ai  h2j  -  (p)i  <  o  . 


If  a'.  Sj  <  0  ,  then  i  6  I4j  and 


>i  h2,j+l  -  (p>i  ’  ai  h2j  '  (p)i  -  ro  a!  ?1 


(p)j  -  ai  h2j  .  \  < 


Hence,  •  f  ■ 


-  s0- 
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Case  4: 


I4.  =  0  and  u)  =  0  .  In  this  case  Step  3.3  of  the  algorithm  applies 
an 

Aj+1  =  (al . av-l,ak)  • 

Because  oj  =  0  the  equality  (4.16)  implies  sj  C  Sj  =  0  which,  for  the  positive 
semidefinite  matrix  C  ,  is  equivalent  to  Cs^  =  0  .  Thus 

CXjUj)  =  ClXjItj)  -  tj  s,l  . 

Furthermore,  by  the  definition  of  Tj  in  Step  3.3  of  the  algorithm 

HfXjU)  -  H  h)  ■  <b>k +  Vp)k  • 

Therefore,  it  is  not  difficult  to  show  that 


Vl(t)  =  Xj(t)  '  T1  S1  -  (t-ty  t2  S1 

vj+1(t)  =  VjCt)  -  (t-tj)  T2  s2 
is  a  solution  to  (4.11).  Hence  we  have 

hl,j+l  =  hlj  '  T1  S1  ’  h2, j+1  =  h2j  ‘  T2  S1  •  (4>18) 


Let  i  be  the  index  of  a  secondary  active  constraint  for  Xj+1(tj+^)  . 

If  this  constraint  is  also  a  secondary  active  constraint  for  x.(tj)  ,  then 
Xj+lUj+l)  =  Xj(tj)  -  t ^  s1  with  t1  >  0  .  Thus  t.+1  =  tj  implies 


a;.  Sj  ■  0  ,  i.e. 


ai  h2,j+l  -  <p>i  s  ai  h2j  -  <»>i  5  0  • 


If  the  i-th  constraint  is  not  a  secondary  active  constraint  for  x-(t-)  , 

J  J 


then  i  e  Igj  and 


ai  h2, j+1  -  (P>1  =  ai  h2j  -  <P>i  -  '2  ai  S1 

(P)i  -  a;.  h2j 


=  ai  S1 


<  0  . 


-  T  > 


~  ai  S1 


Therefore,  I,  .  .  =  0  . 

1  »  J+  1 
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Lemma  9 


For  every  jQ  with  Ijj  =  0  and  I gj  *  0  there  is  j1  >  jQ  such 
that  0  0 

’«  -  0  '  J’W1 . jl 

hi  *  0  •  J'VV1 . Jr1-  '2jj  -  0  • 

Proof: 

If  I j j  =  0  and  I?.  *  0  then  Step  1.2  and  Step  3  of  the  algorithm  are  used 
to  determine  the  matrix  Aj+^  and  Mj+j  .  With  tj+j  =  tj  and 

xjtl(t>  =  hl.J+l  +  (‘‘Vl’  h2.J+l 

it  follows  from  formulas  (4.18),  (4.17),  (4.15),  and  (4.14),  respectively,  in 
the  proof  of  Lemma  8  that 


hl.j+l 

=  hld  - 

T1  S1  »  h2, j+1  =  h2j  "  t2  S1  ’  T1  >  0 

(4.19) 

hl,j+l 

=  hlj  » 

h2, j  +  1  =  h2j  ”  0  si  5  0  ro)>  0 

(4.20) 

hl,j+l 

=  hlj  ’ 

h2, j+1  =  h2j  • 

(4.21) 

Each  vector 

(h^.,  h2. 

• )  is  uniquely  determined  by  a  submatrix  A. 

J  J 

of  A  . 

Thus  there  are  only  finitely  many  different  vectors  ( h ^ j ,  h^j)  • 

First  assume  that  (h^  .+j,  hj  -+j)  is  given  by  (4.19).  In  this  case 
s|CSj  =  0  and,  therefore,  C  s^  =  0  .  Hence  it  follows  from 

-  s  1  ( c  +  t j  q )  -  sJCx^tj)  +  si*j  vj(tj)  ■  (*j(tj))i  •  <9lj)l  *  0 

and  the  equalities 

Chlj  '  <t  -  tj)  C  h2J  +  AJgy  ♦  (t-tjJAJSy'-lc  +  tjq)  -  (t-tj)q  (4.22) 

that 

•  «'sl  ’  92j  Aj  S1  ■  ?2j  ej  ’  <Sy>l  <  0  • 

Therefore,  we  have 

0’hl,j  +  l  ■  -  1  +  S1  ‘  • 
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This  implies  that  (h1^+1  ,  h2j+1)  is  determined  by  (4.19)  for  at  most 
finitely  many  j  . 


Next  suppose  that  h2  .+1  is  given  by  formula  (4.20).  Then  s^Csj  >  0 
and  it  follows  from  (4.22)  that 


q ' s i  -  HJjCSj  -  92 J  AjSl  =  (Qy),  <  0  . 


With  Q(h2i)  =  q'h2,  +7h2iCh2i  we  have»  therefore» 
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2j  T  7  2j  w  2j 


^h2,j+P  =  ^h2j^  "  Q(q'  S1  +  h2j^  Sl^  +  T"  S1  ^  S1 

2 

=  Q(^2j)  +  °(92j^l  +  T  slCsl  * 


Because  ( 92 j  ^ 1  <  ®  ’  we  ^ave 

a2  (g2j)l 

o(g2j)-j  +  ^-  stiCs1  <  0  for  0  <  a  <  — -J 


siCsl 


By  (4.16)  ,  -  s^Cs1  =  a)  .  Furthermore, 

n1n  { Mi ,  To ) ,  o . 


Thus  Q(h2  j+1)  <  Q(h2j)  .  In  conjunction  with  the  previous  results  this  implies 
that  h,  .  ,  is  determined  by  (4.20)  for  at  most  finitely  many  j  . 

t  ,  J  +  1 


In  order  to  complete  the  proof  of  the  lemma  it  suffices,  therefore,  to  show  that 
for  at  most  finitely  many  consecutive  indices  j  we  have 


h2, j+1  =  h2j  • 


(4.23) 


It  follows  immediately  from  Step  3.1  and  Step  4.1  that  for  every  j  with 


h2  j+1  =  h2j  ’  t*iere  a  ^ar9est  integer  j  such  that 


h 2 , j  + 1  =  h2j  »  J=J  .J  +  1 .  -  •  - , J 


and 


ak  €  span  j  ai  i  €  J  (x^*)  | 
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where  k  is  the  index  determined  in  Step  1.1  of  the  algorithm.  Define  the 
set  I  of  integers  in  such  a  way  that  i  €  I  if  and  only  if 


and 


Furthermore,  define 


a;  Xj(tj)  *  (b),  ♦ 

a,  €  span  {  a(  |  i  e  J(xj)  j  . 


I  = 


Set 


i  €  J(x*)  ,  (gjj)^  .  =  o  with 


d  =  q  +  C  h2j 


=  l 


and  consider  the  minimization  problem 

a-  h  =  (p)i  , 


i  €  J(Xj)  -  I 


min^d'hl'  1  J  „  1 

h  *■  a’,  h  +  A...  =  (p).  ,  X.  >  0  ,  i  €  I  u  I  1 


(4.24) 


We  apply  the  simplex-method  with  Bland's  [1]  minimum  index  rule  to  this 
problem.  An  initial  basic  feasible  solution  is  given  by 


h  =  h2j  ,  X.  =  0  ,  i  e  I  . 

let  sv 

be  such  that 

«i  K 

=  0  ,  i  €  J(x^)  ,  i  *  v 

J 

a‘  $ 

=  1  . 

V  V 

-  X  s 
2j  v 

into  the  objective  function 

(4.25) 


candidate  for  a  basic  variable  if 


-  d '  s  =  -  (q‘  +  h~o  C)  s  <0 

v  2j  '  v 

Replacing  j  with  j  in  (4.22)  and  using  (4.25)  we  obtain 

-  (q-  ♦  h^C)Sv  =  ("y)v  . 

This  implies  that  X^  will  become  a  basic  variable,  where  1  is  the  same  index 
as  the  one  determined  in  Step  1.2  of  the  algorithm.  Thus  s-j  =  s^  as  defined  by 
Step  3.1  of  the  algorithm. 
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A  baric  variable  Xi  is  a  candidate  for  becoming  a  nonbasic  variable  if 
-  a^  Sj  >  0  .  If,  for  all  i  €  I  , 

-  a'-  <  0  or  X1  >  0 

then  the  new  basic  solution  is  different  from  h,^  .  If,  for  some  i  €  I  , 


ai  S1  ’  0 


and 


X.  -  0 


then  i  €  I 


4j 


and 


Xk  will  become  a  nonbasic  variable,  where  k 


is  the 


index  determined  in  3.1  of  the  algorithm 


Thus  every  iteration  of  the  algorithm  such  that  j  >  j  +1  and  h0^+j  =  h 2 j 
is  equivalent  with  an  iteration  of  the  simplex  method  applied  to  (4.24).  By 
Bland's  rule  this  implies  that  there  are  at  most  finitely  many  consecutive  j 
such  that  (4.23)  holds. 


Using  the  above  results  we  can  now  establish  the  main  theorem. 


Theorem 


The  algorithm  determines  a  finite  number  of  parameter  values  t  , 

and  vectors  h,  .  ,  h0 .  ,  j=0, 1, . . . ,v-l  ,  such  that 


1) 

ii) 

iii) 


For  j=0,l,. . . ,v-l  , 

x.(t)  =  hj.  +  is  an  °Ptimal  solution  to  the  problem 

(2.1)  for  all  t  with  tj  <  t  <  t.+l  . 

Either  t  >  t  or  (2.1)  has  no  optimal  solution  for  any  t  >  t  . 


Proof: 

It  follows  from  Lemma  7  through  9  that,  for  every  j  ,  with  t •  =  tj+^  ,  there 
is  some  j ,  >  j  such  that 

h  =  Vi =  ‘  ‘j,  + 1  •  (4-M) 


Furthermore,  for  every  j  , 


is  uniquely  determined  by  the  matrix  Aj-  whose  columns  are  the  gradients 
of  the  primary  active  constraints.  Since  by  the  definition  of  tj+^  the 
vector  Xj(t)  is  not  an  optimal  solution  to  (2.1)  for  any  t  >  t^+1  it 
follows  from  (4.26)  and  the  fact  that  there  are  only  finitely  many  different 
submatrices  of  A'  that  the  algorithm  terminates  with  some  t  .  If 
t  <  t  ,  termination  occurs  either  with  Step  2  or  with  Step  3  of  the 
algorithm  in  which  case  Lemma  6  asserts  that  the  given  problem  has  no  optimal 

solution  for  any  t  >  t  . 
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